Tracking Object Motion Across Aspect Changes for Augmented Reality

A model registration system capable of tracking an object through distinct aspects in real-time is presented. The system integrates tracking, pose determination, and aspect graph indexing. The tracking combines steerable lters with normalized crosscorrelation, compensates for rotation in 2D and is adaptive. Robust statistical methods are used in the pose estimation to detect and remove mismatches. The aspect graph is used to determine when features will disappear or become di cult to track and to predict when and where new features will become trackable. The overall system is stable and is amenable to real-time performance.